Flora: Dual-Frequency LOss-Compensated ReAl-Time Monocular 3D Video Reconstruction

نویسندگان

چکیده

In this work, we propose a real-time monocular 3D video reconstruction approach named Flora for reconstructing delicate and complete scenes from RGB sequences in an end-to-end manner. Specifically, introduce novel method with two main contributions. Firstly, the proposed feature aggregation module retains both color reliability dual-frequency form. Secondly, loss compensation solves missing structure by correcting losses falsely pruned voxels. The enhances quality precision recall, benefits recall. Notably, contributions achieve great results negligible inferencing overhead. Our state-of-the-art experimental on real-world datasets demonstrate Flora's leading performance effectiveness efficiency. code is available at https://github.com/NoOneUST/Flora.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Real-Time Active 3D Shape Reconstruction for 3D Video

In this paper, we focus on the real-time 3D shape reconstruction of an object moving in a wide area(e.g. a dancing human). To efficiently record dynamically changing 3D object shape, the real-time 3D shape reconstruction and active tracking are required. For the real-time 3D shape reconstruction, we propose a parallel plane-based volume intersection method. By implementing the algorithm on a PC...

متن کامل

Real Time Speed Estimation from Monocular Video

In this paper, detailed studies have been performed for developing a real time system to be used for surveillance of the traffic flow by using monocular video cameras to find speeds of the vehicles for secure travelling are presented. We assume that the studied road segment is planar and straight, the camera is tilted downward a bridge and the length of one line segment in the image is known. I...

متن کامل

Near Real-Time 3D Reconstruction from InIm Video Stream

An efficient hardware architecture for the acceleration of an integrated 3D reconstruction method is presented, targeting demanding dynamic Integral Imaging applications. It exploits parallel processing and features minimized memory operations by implementing an extended-access memory scheme. Its reduced data throughput, thanks to optimized data utilization, makes it suitable for single FPGA de...

متن کامل

Real-time Free-viewpoint Video Based on 3D Shape Reconstruction

In this paper, we present a system generating free-viewpoint video in real-time using multiple cameras and a PC-cluster. Our system firstly reconstructs a shape model of objects by the visual cone intersection method, secondly transforms the shape model represented in terms of a voxel form into a triangular patch form, thirdly colors vertexes of triangular patches, and finally displays the shap...

متن کامل

Towards Robust 3D Reconstruction of Human Motion from Monocular Video

A robust, adaptive system for reconstructing 3D human motion from monocular video is presented. Our system takes a model based approach. To save computation time, we fit the skeleton instead of full body model to the silhouette as one constraint. End sites positions identified from the silhouettes serve as another constraint. The alleviation of computational burden then makes the use of simulat...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence

سال: 2023

ISSN: ['2159-5399', '2374-3468']

DOI: https://doi.org/10.1609/aaai.v37i2.25358